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MATCHING PROCESS 

This invention relates to a matching process for use in a contention resolution scheme for 
a multi-stage switch arrangement particularly but not exclusively for a cell, packet or circuit 
5 switch or network. In particular, but not exclusively, the invention relates to a scalable 
hierarchical matching algorithm, particularly but not exclusively suitable for matching 
asymmetric request matrices. 

The term "matching" refers to the matching of requests for transmitting input-queued 
10 traffic to available outputs when scheduling cells or packets for transmission across a 
switch. The term "input-queued traffic" refers to traffic buffered at the input ports of a 
switch prior to switching across the switch fabric. An overall scheduling operation 
comprises the matching process described herein and a time-slot assignment process 
which determines actual channel availability for transmission across the switch fabric. 
15 One example of a time-slot assignment process is described by the inventors in their 
United Kingdom Patent Application No. GB-A-0322763.4, the contents of which are 
hereby incorporated into the description by reference. 

The term switch is used herein to refer to switches and/or routers and/or networks which 
20 forward data towards their destination, such as are used in communication networks, for 
example, the Internet The present invention also relates to the matching of circuit- 
switched service requests, such as connections and information rates, for switching 
across a switch fabric. This description is written in terms of cell and packet switches, but 
the principles also apply to circuit switches (for example, in the context that the matching 
.25 process seeks to grant service requests without contention, and the services requests can 
equivalents be requests for bandwidth etc. in a circuit switch). 

As communication networks, particularly the internet, evolve, faster and more efficient 
switches are needed, for example, switches capable of exceeding Terabit per second 
30 throughputs. There is therefore a demand for faster and more efficient high-throughput 
schedulers to schedule traffic through such switches, and therefore a demand to generate 
computationally faster and more efficient scheduling algorithms. 



Packet switching involves the switching of data in packets through a data network. An 
35 arriving packet could be variable or fixed length, unicast or multicast. A packet is 
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multicast if it has more than one destination port. Variable length and/or multicast packets 
can be transferred to fixed-length unicast packets by methods well known in the art, and 
the term "cell" is used to refer to a fixed-length unicast data packet. A cell consists of the 
header and payload, and each cell has a unique identifier, a sequence number and the 
5 destination address (the destination output port number) of the cell which is encapsulated 
in the header. 

Input Queued Switching Schemes 

10 Figure 1 of the accompanying drawings shows a general model of an N x N switch where 
of the N input and N output ports, only three input and three output ports are shown for 
convenience and clarity. Accordingly in Figure 1, switch 1 is shown having input ports 2a, 

2b 2n an <* output ports 3a,3b,...,3n. Each input port 2a, 2b 2n is provided with one 

(or more) input buffers 4a,4b,...,4n respectively, the buffer(s) for each port being controlled 

15 by one or more buffer controllers 5a,5b,...,5n respectively. In a virtual output queued input 
queued switch, a number of virtual output queues (VOQ) are provided: each input port 
having a VOQ for each destination port (i.e., each input port in the N x N switch has N 
VOQs) and pointers are used to point to the addresses of the cells in each VOQ. VOQs. 
are described in more detail later herein below. 

20 

A scheduler 6 is used to schedule the transmission of the cells arriving along the input 
links 8a,8b,...,8n to their destination links 9a, 9b,...,9n. The scheduler 6 determines 
which cells from which VOQs traverse the switch fabric 7 during a switch cycle. The 
function of the scheduler can be distributed between the input and output ports, such that 

25 each input and output port has an arbiter associated with it, either physically or logically. 
Generally, a scheduler operates to switch one cell per timeslot, i.e., one cell is switched 
per period of time for a cell to be transmitted across the switch fabric 7. However, frame- 
based schedulers are known in the art in which a plurality of cells are switched over a 
plurality of timeslots. The operation of the switch is then synchronised over a plurality of 

30 fixed-size timeslots, which constitute a frame. 

In Figure 1, the switching fabric 7 comprises a suitable interconnecting network in the form 
of single-stage or multiple-stage space and/or wavelength switches. Some or all of the 
wavelength switches can be implemented as wavelength-switched networks. Figure 1 for 
35 clarity only shows the possible internal input-output links 10a,10b,...,10n for input port 2a, 
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but each input port 2a,2b,..,2n will have possible internal input-output links connected 
through the switch fabric 7 towards the appropriate destination output ports 3a,3b,...,3n. 
Each internal input-output link within the switching fabric 7 is assumed to be capable of 
transmitting data at a speed of one cell per timeslot. It is not necessary for an input link 

5 8a,8b 8n (each of which connects to their respective input port 2a,2b,...,2n) to the 

switch to operate at the same speed as an internal input-output link (e.g., input-output link 
1 0a, 1 0b 1 0n) within the switch fabric 7. 

During each timeslot the interconnecting network of the switch fabric 7 is capable of being 
1 0 configured by the scheduler to simultaneously set up a set of transmission paths between 

any pair of input ports 2a,2b,...,2n and output ports 3a,3b 3n provided no more than a 

predetermined upper limit of cells are transmitted by an input port 2a,2b,..,2n or received 
by an output port 3a,3b,...,3n during each frame. 

15 If the packet switch 1 is to process variable sized packets, or non-unicast packets, the 
appropriate conversion steps into fixed sized packets (or cells) is assumed to have 
already occurred and thus these components are not shown in Figure 1. In Figure 1, each 
input link 2a,2b,..,2n provides fixed sized packets (i.e. cells) to cell input buffer 4a,4b,..,4n 
and buffer controllers 5a,5b,...5n respectively for header translation, addressing, and 

20 management functions which are performed on the incoming cells. The scheduler 6 
processes the fixed-sized cells so that the switch fabric 7 operates in a synchronous 
manner. 

The role of the scheduler 6 thus comprises matching each cell residing in an input buffer 
25 to its destination output port. Thus the scheduler 6 can be considered to be repeatedly 
solving a bipartite matching problem for each timeslot, in the manner described by 
Anderson et al, "High-speed switch scheduling for local-area-networks D , ACM 
Transactions on Computer Systems, vol. 11, no. 4, pp 319-352. By providing an 
appropriate match, e.g. matching a maximum number of input ports to output ports, or 
30 matching a maximum weighted number of input ports to output ports, in each switch cycle, 
the scheduler 6 is considered as treating the queued traffic in a useful and fair manner, 
depending on the nature of the traffic matrix. 

In general, fixed-size packets (cells) are assumed to be switched in the switch fabric 7 to 
35 support high speed operation of the switch 1. As was mentioned above, if variable length 
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packets are to be supported in the network, such packets are segmented and/or padded 
into fixed sized cells upon arrival, switched through the fabric of the switch, and 
reassembled into packets before departure. 

5 Output contention can arise when cells destined for the same output port arrive 
simultaneously at the switch 1 at more than one input port. To suppress cell losses, such 
cells are buffered by the switch 1 until they can be transferred to their destination output 
ports. The operation of the matching algorithm can potentially cause input contention, 
where more than one cell could be scheduled for transmission across the switch fabric 
1 0 from the same input port This must be avoided by the matching algorithm. Whilst switch 1 
supports a virtual output queuing (VOQ) scheme for the input queuing (IQ), a number of 
alternative queuing strategies are also known in the art, output queuing (OQ), shared 
queuing (SQ), and combined input-output queuing (CIOQ). 

15 In a conventional input queued switch, basic input queuing (IQ) avoids using high- 
bandwidth buffers by providing a buffer for each input port for incoming packets. With this 
queuing scheme, the bandwidth demand of each input buffer is reduced to at least one 
write operation and one read operation per time slot With a properly designed scheduling 
algorithm, a set of input-output contention free cells is selected from the buffered cells for 

20 transmission to their destination oufcut ports, from time slot to time slot When the overall 
scheduling operation is applied to a number of timeslots simultaneously in a frame of 
timeslots, scheduling comprises two sub-processes, matching and timeslot assignment 
These processes will be described in more detail later herein below. 

25 Whilst output queued (OQ) switches and shared queue (SQ) switches can generally 
achieve better performance than Input queued switches and combined input-output 
queued switches, this is only so for a finite size of N X N switch. As the number of input 
and output ports of the switch increases, the bandwidth demand of the OQ or SQ buffer 
grows linearly as the aggregated input-output link rate increases. Accordingly, it is known 

30 in the art that OQ and SQ switches generally do not scale very well. As the switch 
architecture of an input queued (IQ) switch with FIFO queuing (and similarly a Combined 
Input-Output Queued (CIOQ) switch) is much simpler than that of OQ and SQ switches, 
IQ and CIOQ switches generally scale better than OQ and SQ switches as each input 
buffer maintains a single FIFO for all incoming cells. However, despite the simplicity in 

35 the switch architecture of an IQ switch with FIFO queuing, the maximum throughput is 
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relatively low for uncorrected (Bernoulli) traffic with destination outputs distributed 
uniformly (for example around 50%-60% or so), and the throughput is worse for correlated 
(on/off bursty) traffic. This is a result of the HOL blocking problem, in which a cell queuing 
behind the HOL cell of a FIFO cannot participate in scheduling, even if both its residing 
5 input and destination output are idle. 

By supporting Virtual Output Queuing (VOQ) in the input ports of an IQ switch, HOL 
blocking can be removed. The Virtual Output Queue (VOQ) scheme (also known as the 
multiple input queuing scheme) is described in The iSLIP Scheduling Algorithm for Input- 
10 Queued Switches" by N. McKeown, IEEE/ACM Trans. Networking, Vol. 7, No. 2, pp. 188- 
200 (April 1999), and United States Patent Number US 5500858, the contents of which 
are hereby incorporated by reference). 

Conventionally, in an input-buffered VOQ switch, a fixed-size packet (or cell) is sent from 
15 any input to any output, provided that, in a given timeslot, no more than one cell is sent 
from the same input, and no more than one cell is received by the same output. Each 
input port has N VOQs, one for each of N output ports. The HOL cell in each VOQ can be 
selected for transmission across the switch in each timesloL Accordingly, in each 
timeslot, a scheduler has to determine one set of matching, i.e., for each of the output 
20 ports, the scheduler has to match one of the corresponding VOQs with the output port. 

Figure 2 of the accompanying drawing shows schematically a 4 x 4 VOQ IQ switch 20. 
Switch 20 has four input ports #a1 . #a2, #a3, and #a4 and four output ports #b1 , #b2, #b3, 
and #b4 which are capable of being interconnected by an internal switch fabric 21 . Each 
25 input port #a1, #a2, #a3, and #a4 has four VOQs, one VOQ for each of the destination 
output ports #b1, #b2, #b3, and #b4. In Figure 2, the VOQs are denoted VOQ#ai#bj 
where i, j ranges from 1 to 4 respectively. 

It is known in the art that the implementation of a VOQ scheme can enable up to 100% 
30 throughput to be achieved. Scheduling algorithms such as maximum weight matching 
algorithms have a high level of complexity, e.g. the number of calculations to be 
performed per single time-slot matching is 0(N 3 ). Currently, the amount of time it would 
take to perform such an algorithm to calculate the matching is impractical under high- 
speed environments where the duration of a time slot (the time taken to run a switching 
35 cycle i.e., to transport a cell from an input port to its destination port across the switch 
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fabric) is very small. 

Other scheduling schemes known in the art include a three-stage switch scheduling 
scenario in which a large packet switch is decomposed into a number of smaller switched 
having fewer ports (see Joseph Y Hui in "Switching and Traffic Theory for Integrated 
5 Broadband Networks", Kluwer Academic Publishers, 1990, Chapt. 5, and J S Turner, 
"WDM Burst Switching for Petabit Data Networks", OFC 2000 presentation). However, in 
these known schemes each switch has its own buffering which requires scheduling to be 
performed independently for each switch. No scheduling occure between the switches, 
which leads to at least two limitations. Firstly, heuristic rules are required (e.g. load 
10 spreading between switches) to enable a reasonable switch performance to be 
maintained. Secondly, packets may arrive at their destination out of sequence. 

Contention Resolution in an Input Qu eued Virtual Output Queued Switch 

15 Consider the N X N switch shown in Figure 1. In Figure 1, the switch 1 has N input 
queues in each input port. Accordingly, there are N 2 VOQs in total. However, switch 1 
has only N output ports to transfer at most N cells to in a given timeslot Thus contention 
occurs amongst the N 2 VOQs. 

20 Several methods are known in the art which seek to resolve this contention issue. One 
known technique to reduce the computing time complexity is to use a heuristic maximal- 
sized matching algorithm such as the iSLIP scheduling algorithm by N.McKeown. Like 
many matching algorithms, iSLIP comprises 3 phases known as the request, grant, and 
accept phases. In the request phase, each of the N 2 input queues sends a request to the 

25 output ports. In the grant phase, each of the output ports grants one request among its 
own receiving requests using a suitable selection operation and notifies the result of grant 
to each of the input ports. An input port may receive several grants from each output port 
at the same time so that in the accept phase each of the input ports accepts one grant 
amongst its own receiving grants using a suitable selection process. Several request- 

30 grant-accept cycles are iteratively performed. 

With such a three-phase, matching approach, a problem which needs to be addressed to 
optimise the matching process is how to ensure that the selection processes fairly and 
quickly select and grant one request from a plurality of requests which could be granted 
35 (and equivalent^ accept one grant from a plurality of grants which could be accepted). In 
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iSLIP, this selection process is achieved using a particular set of pointer rules. iSLIP can 
be faster than alternative schemes which use random selection. Unfortunately, in the 
iSLIP algorithm, as the number of input ports and output ports increases, the'number of 
requests and grants which must be selected between in the grant and accept phases 
5 within one time slot increases. Although the ISLIP algorithm has less computing 
complexity than a maximum matching algorithm it has a limitation: iSLIP requires the 
maximal matching to be completed within one timeslot. Again, as the switch size 
increases or if a switch has very high port speeds (either because the matching time itself 
increases beyond the time for one time slot, or because the timeslot itself has a shorter 
10 duration) iSLIP is no longer suitable. 

Several other matching schemes have been devised in the art which seek to provide 
greater scalability and so support faster switch cycles. For example, pipeline-based 
scheduling algorithms such as the Round-Robin Greedy Scheduling (RRGS) allows each 

15 input to perform only one round-robiri arbitration within a given time slot to select one 
VOQ. For a switch with N inputs. W input round-robin operations (to select a cell to be 
transmitted, at a given time slot T) are allocated to the different previous N time slots {T-N, 

T "( N+1 ) T_1 } in a simple cyclic manner to avoid output contention. A drawback of this 

scheme is when traffic is not balanced across the input of the switch, some inputs can 

20 unfairly send more cells than others. Whilst other schemes are known in the art to 
guarantee pre-reserved bandwidth, for example, the weighted RRGS scheme, this has a 
drawback in that it does not guarantee fairness for best-effort traffic and a further draw 
back in that as every even number of timeslot cycles an idle timeslot is produced resulting 
in the switch capacity not being fully used. 



25 



Overview of Frame-Based Scheduling 



As was discussed briefly in the introduction, the overall scheduling operation comprises 
two sub-processes, a matching process and a timeslot assignment process. A similar 
30 division exists where a frame-based scheduling approach is implemented. 

The frame based approach comprises two steps for each frame. The first step involves a 
matching process in which a number of cells queued at the inputs are accepted for 
transmission to outputs in a non-contentious manner. The second step involves a time- 
35 slot assignment process in which the successfully matched cells are scheduled for 
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transmission in the different time slots of the frame. This time-slot assignment step can 
be considered to be equivalent to scheduling a set of non-conflicting requests in a time- 
frame, which can be performed using known path-searching algorisms such as those 
used to route circuits in a Clos interconnection network, for example, see WO01/67783 
5 "Switching Control" and also WO01/67803" Frame Based Algorithms for Switch Control", 
and WO01/67802 "Packet Switching", all three of which are hereby incorporated by 
reference. 

At the beginning of a frame, the total number of packet requests from each input port to 
10 each output port as a pair is collected into an N x N Request Matrix R (the request phase 
of the process). Each element r(i,j) of this matrix is an integer showing the total amount 
of stored packets in the VOQ between input port i and output port j. 

The matching process populates a symmetric N x N Accepted-Requests matrix A. Each 
15 element, a(ij) of A represents the total number of accepted switching requests from the 
VOQ between input port I and output port j, i.e., requests that have been accepted to be 
switched during the following time period (frame) available for transferring one or more 
cells between an input port and an output port using one or more timeslots. Each 
accepted request a(i,j) of A is constrained by the overall capacity of the switch input and 
20 output ports "P , i.e., the sum of elements in each row and each column must not exceed 
the frame size F; .i.e. the number of time slots or cells in the frame. Various matching 
algorithms are known in the art to try to optimise the use of the available switch capacity. 
All of these matching algorithms seek, in each time period consisting of one or more time 
slots, to determine a non-conflicting match between the input ports and the output ports of 
25 a switch fabric of an N x N symmetric request matrix. 

For example, where F = 1 (and for unicast traffic) a matching process will seek to link 
each input port to at most one output port and each output port is linked to at most one 
input port. A complete matching of the input ports to the output ports in one timeslot is 

30 then equivalent to determining the appropriate permutation of the input ports. However, 
as a complete matching cannot always be achieved, maximal matching algorithms seek to 
optimise the selection of which cells should be transmitted from input to output per 
timeslot. This optimisation depends on a number of factors selected according to the 
particular embodiment of the matching algorithm implemented and can depend, for 

35 example, on the length of queue and/or how long the cell at the head of each queue has 
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been queued for. 

Frame-based matching where F £ 1 has already been described in the art, for example, in 
"Frame-based matching algorithms for input-queued switches" by Andrea Bianco, Mirko 
5 Franceschinis, Stefano Ghisolfi, Alan Michael Hill, Emilio Leonardi, Fabio Neri, Rod Webb, 
HPSR 2002, Workshop on High Performance Switching and Routing, Kobe, Japan, 26-29 
May 2002, the text of which is incorporated herein by reference. Bianco et al describe a 
frame-based switch contention resolution scheme which can be considered to comprise 
two-steps for each frame (a frame being considered to be a set of one or more time-slots). 

10 

Consider a frame whose length is F(i.e., whose transmission could occupy F consecutive 
timeslots). A set of cells selected to be transmitted in the timeslots belonging to the next 
frame is selected at the end of the current frame, i.e., switch control occurs on a multi- 
time-slot basis at the edge of each frame boundary. The set of cells selected for 
15 transmission is termed the Fmatch, and this needs to always comply with the joint criteria 
that i) the total number of selected cells from each input port cannot be larger than F and 
ii) the total number of selected cells which are to be transmitted to each output port cannot 
exceed F. Equivalently, if aij is the number of accepted cells from input i to output j, the 
constraints are: 

20 Eqn. 1 Y* a u ~ F V J and 

i 

Eqn. 2 Y* a u - F V 

j 

The selection of the cells forming the set to be transmitted in the next frame is made using 
an Fmatching algorithm (and where F=1, the Fmatching is equivalent to a conventional 
time-slot by time-slot approach). Once the Fmatch has been obtained, cell transmissions 
25 need to be assigned to different timeslots of the frame, i.e., a set of at least F switch 
permutations capable of transferring all cells belonging to the F-match in a non-conflicting 
manner. 

The frame-based matching scheme Bianco et al describe is implemented using a 
30 request/grant/accept scheme in a manner similar to iSLIP. iSLIP utilises a rotating priority 
scheme in which the selection of requests to be granted (at outputs) and of grants to be 
accepted (at inputs) is implemented using two sets of N pointers, one for each input and 
one for each output. An output (input) pointer points to the input (output) port to which 
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highest priority is given in issuing grants (acceptances). Accordingly, grants and 
acceptances are given to the first busy queue in a cyclic order starting from the current 
pointer position. Input and output pointers are up-clated after each matching to the first 
input (output) following the one which has been accepted. 
5 • 

Bianco et al also describe a "No Over Booking" (NOB) matching algorithm consisting of a 
generalisation of the known iSLIP algorithm by McKeown et al, but one or more iterations 
(i.e., a generalisation of 1-SLIP) and associated pointer update rules. The NOB algorithm 
output booking and input booking steps are described in detail in Bianco et al, and are 

10 incorporated herein by reference. Brief iy, the NOB algorithm steps through an output 
booking phase followed by an input booking phase, similarly to iSLIP. In the output 
booking phase, each virtual output queue (VOQ) requests a number of time-slots in the 
appropriate output frame, and as a reply each output port issues up to F grants distributed 
amongst the N VOQs destined for that output. The total number of requests is 

15 represented by a request matrix R, whose elements ry represent the total number of time 
slots requested by input port / for output port j. 

In general the length qy of each VOQ (i.e. the number of cells queued) can be greater 
than the frame length F. The number of actual requests made by each VOQ from the 
20 request matrix R is up to qy when q^ < F but if q irJ £ F then up to F (as no more than F 
time slots can be requested at any one time). The request matrix R is distinguished from 
the normalisation phase matrix to be discussed below which uses as its input "requests" 
the actual queue lengths, but which does not reduce the number of requests in each VOQ 
to the frame length F prior to the first stage of matching. 

25 

During the output booking phase, each output port operates simultaneously, hence output 
ports operate independently, so that there is no guarantee that the total number of grants 
received by VOQs at one input port will not exceed the capacity of the input frame. To 
remedy this, each input port accepts up to F of the grants received at that port. Each 
30 acceptance received by a VOQ at one input port gives that port the right to transmit one 
cell in the next frame. 

The NOB frame matching algorithm Bianco et al describe is. in some sense therefore a 
hybrid between a maximum weight matching (MWM) (which assigns a weight to the cells 
35 at the head of each VOQ, and which optimises the cumulative weight of cells which are 
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successfully matched) and a maximum size matching (MSM) (which addresses optimising 
on the basis of the overall number of cells which are successfully matched being a 
maximum).. In each phase, the final steps fn the above algorithms begin on an initial VOQ 
which is indicated by a pointer. Accordingly, each output port maintains a pointer showing 
5 which input port should be given priority for its additional grants in the final output booking 
step, and each input port keeps a pointer showing which output port has priority in its final 
input booking step. Several schemes are known in the art for updating the pointers so that 
a level of fairness is maintained. 

10 Prior art such as United States Patent number US 6,487,213 entitled "Methods and 
Apparatus for Fairly Arbitrating Contention for an Output Port" by Chao describe 
hierarchical arbitration methods in which requests are aggregated together, but arbitration 
is performed independently for different output ports. Matching is not performed globally 
between all input and output ports to solve contention across the entire switch fabric, nor 

15 does Chao address the issue of resolving contention in an input-switch, as Chao 
addresses the issue where both input and output queuing are provided. 

Consider when the original request matrix R 0 is transformed to a. normalised request 
matrix R nofm by transformation factor d. The original request matrix R 0 could be, for 
20 example, the matrix of VOQ queue lengths (i.e. numbers of requests or cells queued in 
each VOQ) or a measure of the requested traffic rates. An example of a transformation 
factor d is described later. R r = R„ - R norm j s the request matrix of remaining requests 
given by the original request matrix R 0 and FUm is the partially populated Accepted- 
Requests matrix A from the first stage of the matching. R r is used to fill up as much of the 
25 remaining capacity of the frame as possible, by running another matching algorithm 
(which could be the same as the first or different) in a second stage to populate a second 
accepted requests matrix A 2 derived from the matrix of remaining requests R r . The final 
matrix of accepted requests A = R norm + A 2 , i.e., A is just the sum of the two matrices found 
during the two stages. Consider the following example request matrix 

r 3 4 2 0' 
5 0 10 



30 Eqn.3 R 0 = 



8 5 13 

V 



V 2 0 2 6, 

This is transformed by a transformation factor d= F/max (F.mval), where F = 8 and mval is 
defined to be the maximum sum of any one column or row in R 0 , i.e., 
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/ \ 

Eqn. 4 mval = max(^*u i£j£4 , i£iz4) 



Here d = 8/18 and thus R 0 = L4R/9J, where the elements of R 0 are the integer parts of the 
resulting numbers. For this example, then 
'110 0^ 



Eqn. 5 ^ = 



2 0 0 0 

3 2 0 1 
v 0 0 0 2 j 



5 The remaining request matrix = 

(2 3 2 0\ 



Eqn. 6 R f = R 0 - R 



10 



3 0 10 
5 3 12 
^2 0 2 4J 

A second matching procedure is then performed on the remaining request matrix R r which 
produces another Accepted Requests matrix A 2 . The total Accepted Requests Matrix A 
per frame is then given by the sum of R n0 mi and A 2f i.e., A = R n0 rm+ A 2 . 

Therefore the operation of an existing, example single-level matching algorithm known, in 
the art can be summarised as follows. 



Normalisation Stage 

15 First the elements in the request matrix are transformed by normalising them according to 
the highest queue value and the total number of timeslots available in a frame, so that in 
the normalisation phase: 



20 



25 



Eqn. 7 [r(ij)] [r nonil (i,j)], r r (i j)] 

"No Overbooking" Stage 

This comprises an output booking phase followed by an input booking phase. In 
the output booking phase, a granted-request matrix is formed from the matrix of remaining 
requests, i.e., in the output port booking phase the grants are derived as follows: 

Eqn. 8 [r^j)] [gflj)] ; £ g(i,j) * F- []T Q„ 0 „n<i,j)], 



WO 2005/032167 



13 



PCT/GB2004/004159 



where Qnorm is the number of normalised requests queued for a particular output port. In 
the input booking phase, an accepted grant matrix is generated from the matrix of granted 
requests, i.e., the accepted grants populate this matrix according to: 

Eqn. 9 . [g(ij)]=*[a(i,j)l; £ a(ij)<F 

j 

5 

Time Slot Assignment 

The second process of the scheduling algorithm is the Time Slot Assignment. It attempts 
to compute the set of switch (or network) configurations for each time slot, such that the 
matrix of accepted requests can be transferred from the input ports to the output ports 
10 across the switch without blocking any packet, i.e., to ensure there is a free timet slot 
available for each packet from its input port to its desired output port. This is not always 
possible, depending on the Time Slot Assignment algorithm and the number of time slots 
(switch permutations) available. Some or even all of this set of switch permutations may 
be the same. As an example, consider the request acceptance matrix 

15 Eqn. 10 A = [a(i\j), 1 < (i, j) < 4] = 

A possible set of 8 switch permutations to send these numbers of cells or packets from 
input ports to the output ports (elements in the table) across the switch is shown in the 
following table 



Time slot ► 
Input Port ▼ 


1 


2 


3 


4 


5 


6 


7 


8 


1 


1 


1 


2 


2 


2 


2 


3 


3 


2 


3 


4 


1 


3 


1 


3 


2 


1 


3 


2 


2 


4 


4 


3 


1 


1 


2 


4 


4 


3 


3 


1 


4 


4 


4 


4 



20 

If we call this set of permutations P„, where n is the time slot within the frame (l<,n<,F), 
then it would correspond to the following sequence of permutation matrices 



2 4 2 0 

3 13 1 
2 3 12 
10 2 5 
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Eqn. 11 



Several algorithms are known in the art suitable for implementing time slot assignment, 
5 with different blocking characteristics, dependent also on the number of time slots (switch 
permutations) available. 

Referring now to Figure 2 of the accompanying drawings, an input queued cell (or packet) 
switch arrangement is shown. In Figure 2, each of the four input ports #a1..#a4 has four 

10 first-in-first-out virtual output queues (VOQs), designated as VOQa1b1 ...VOQa4b4. Each 
of the VOQs associated with the same input port stores cells destined for a different 
output port, the total length of the queue from input port i to output port j (the number of 
cells to be transmitted in the next time frame) being indicated by q rj where i, j = 1, 2,....,N. 
Cells which queue up in the VOQs generate requests which can be presented by a queue 

15 matrix as shown below (and in Figure 2). In general, the number of cells queued in a VOQ 
can exceed the frame size F. 



20 



As an example of a conventional single-level matching an example queue matrix [Q(i ,j)J 
such as is shown in Figure 2, for a 4x4 switch having a frame duration F of F=4 time slots 
is matched below. The VOQ lengths, i.e. the number of cells or packets waiting in each 
VOQ, are assumed to have a "powers of two" distribution, i.e. 



Eqn. 12 



[Q(ij)l = 



12 4 8 
2 4 8 1 
4 8 12 
8 12 4 



A conventional single-level frame-based matching process in which a number of stages 
25 are present in the matching process will now be described. 



Sinale-Level Matching Normalisation Stage 



The normalisation algorithm first finds the row (input port) or column (output port) with the 
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largest sum of requests (or queue lengths), maxval. Every request (or queue length) is 
then normalised to this maximum value, firstly by being multiplied by the ratio c=F/maxval 
if maxval is >F (or greater than the maximum number ©f grants or acceptances allowed) 
and c=1 otherwise, and secondly by taking the integer part of the resulting number. 

For [Q(i,j)3 in Eqn.12 maxval = 15, which is larger than F (=4). Hence the normalised 
queue matrix becomes 



Eqn. 13 



[QnomO j)] = 



0 0 12 

0 1. 2 0 

12 0 0 

2 0 0 1 



All of these cells or packets are assumed already to be granted by the output ports and 
10 accepted by the input ports. The request matrix presented to the second "no overbooking" 
stage is the difference between the original queue matrix and the normalised queue 
matrix, i.e. the remaining requests 



15 



Eqn. 14. 



[r(i,j)]output =tQ(U)]-[Qnonn(ij)] 



8 1 
1 2 



4 8 
8 1 



0 0 12 

0 12 0 

1 2 0 0 

2 0 0 1 



20 



These requests are used by the w no overbooking" stage to fill up the remaining available 
time slots in the frame as much as possible. 

Single-Level Matching " No Overbooking" Staae Output Booking PhasA 



The number of requests in effect already granted by the output ports in the normalisation 
stage is 

25 EC I n - 15 [J Qnorm(i,j)]=[3 3 3 3 ] 



The remaining number of grants available in each output port is therefore 

Ec l n 16 [F F F F]-[3 3 3 3]=[l 1 1 l] 
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Output booking operates simultaneously in each output port in the three following steps: 

1. if the total number of requests received by the port is less than the remaining 
number of grants available, then all requests to the port are granted. 
5 2. if the number of VOQs with an unsatisfied request destined for the port is less 

than or equal to the remaining number of grants, then the VOQs receive one 
grant each. This step is repeated as many times as possible. 
3. taking the VOQs in turn, starting from the one indicated by a pointer, each 
VOQ with an unsatisfied request receives one grant until the total number of 
1 0 grants given by the port reaches the remaining number of grants in Eqn.16. 



Step 1 does not apply in this case, because the total number of requests r(i,j)] output is 

i 

12 to all ports (from Eqn.14). Step 2 does not apply either, because there are 4 VOQs 
with unsatisfied requests destined for every output port and only one available grant each. 
15 Step 3 applies in this case. 

Single-Lev el Matching Pointer Update Rules 

A deterministic NOB25 pointer up-date rule such as that described by Bianco et al 
20 initialises the pointers so that each output port gives priority to a different input port (and 
vice versa) and the pointer advances by 1 each frame, such that on cycle k of the 
algorithm (i.e. for the k-th frame, starting at k=0>; port P gives priority to port p, where 



25 



Eqn - 17 P = 1+[(LN-P + k) modLN ] 



Hence in the first frame k=0, with LN=4 in this example, output port 1 points to input port 
4, 2 points to 3, 3 points to 2 and 4 points to 1, i.e. the pointers point to VOQ requests 
r(4,1), r(3,2), r(2,3) and r(1,4) in Eqn.14. All of these VOQs have 6 requests, and because 
Eqn.16 allows only 1 more available grant for each output port, each of these four VOQs 
30 will be granted one more request, i.e. the additional output booking grants [g(ij)] are given 
by 



Ec l n - 1 8 [g(ij)] = 



0 0 0 1 
0 0 10 
0 10 0 
10 0 0 
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Sinale-Lev el Matching "No Overbooking" Staae Input Booking Phase 

The number of requests in effect already accepted by the input ports in the normalisation 
phase is 



5 Eqn. 19 



20 



Qnorm(i.j)] = 



The remaining number of additional acceptances available in each input port is therefore 
Eqn. 20 



[£ Qnonn(i,j)] = 

j 



4 




3 




1 


4 




3 




1 


4 




3 




1 


4 




3 




1 



The request matrix for this input booking phase is the additional output booking grants 
10 matrix [g(ij)] (Eqn.18). Step 2 of the "no overbooking- algorithm applies, so all of the 
additional output booking grants are accepted, i.e. the additional input booking 
acceptances [a atfcjaiona ,(i,j)] are given by 

"o o o r 

Eqn. 21 [a^^i j)] - J J J J 

10 0 0 

The final acceptance matrix is the sum of the acceptances from the initial normalisation 
15 (Eqn.13) plus these additional acceptances from the "no overbooking" algorithm (Eqn.21), 

Eqn. 22 



[a(i,j)J = 



Qnoimflj)] + [aaridiHonalOj)] 



All input and output ports fill all F=4 time slots in this first frame. A full set of 16 cell or 
packet requests has been accepted in the first cycle or frame. They are taken from 8 of 
the longest VOQs in Eqn. 12. 



A matching algorithm may not completely fill up the matrix of Accepted-Requests from the 
25 matrix R (i.e., ensure A -R = a null matrix, indicating all requests have been granted). This 
is partly because A is constrained by the fact that the sum of elements a(i,j) in each row 
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and column cannot exceed the number of timeslots in a frame length, F. Referring now 
back to the example request matrix given in Eqn.3 and with frame duration F = 8 

• timeslots, then bom J>,;< 8 V j and <: 8 V i and by the constraint 

that the total of the sums of elements in each column and each row is limited to the total 
5 number of available timeslots IM X K P, i.e., 



4 4 



E2>U* N x F , 

1=1 M 

where N . 4 and F = 8 in this example. This is the maximum possible number of 
.a???P! a npes for the frame. But the matching algorithm may not be able to achieve this 
maximum number. 

10 Thus, as a more specific example, consider where the matching algorithm populates a 
matrix of Accepted-Requests as follows: 

(2 4 2 0^ 



A = 



3 0 10 
2 3 12 
U 0 2.5 



Here F= 8 and N x F = 32, however, YZ a i.j = 28 meaning that the maximum switch 



15 



capacity of 32 requests per time period of 8 time slots has not been utilised. 

The above example illustrates clearly one limitation of such a known frame-based 
matching process, in that the switch capacity may not be utilised fully, resulting in some 
redundant switch capacity in any given frame. 

20 The present invention seeks to obviate and/or mitigate some of the problems related to 
optimising matching algorithms so that their computational complexity is further reduced, 
yet which can more efficiently utilise the switch capacity. Ideally the computational 
complexity is reduced to a level which is suitable, for the high-speed switches which are 
currently being developed for future use. The invention provides a frame based matching 

25 algorithm which seeks to obviate and/or mitigate some of the problems known in the art 
related to optimising matching algorithms by seeking to further reduce the number of 
computing steps in a frame-based matching process from O(LN) to O(L) or O(N) for the 
frame. 
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A first aspect of the invention provides a matching method for a number N of first 
elements, each firsj element arranged to at least provide ingress to a switch arrangement, 
each of the first N elements comprising a number L t of first sub-elements, the switch 
5 arrangement having a number ML 2 of second sub-elements arranged to at least provide 
egress from said switch arrangement, and wherein each of the first L, sub-elements is 
capable of conveying a service request for at least one of said second sub-elements ML 2 , 
wherein the method comprises: firstly, for every one of the N first elements, aggregating 
service requests from all L, first sub-elements to each of the ML 2 second sub-elements, 
10 and secondly, resolving contention for said service requests from all N first elements to 
one or more of said second ML 2 sub-elements, and thirdly, for each first element, 
resolving contention between the L, sub-elements and said second ML 2 sub-elements. 

The step of resolving contention between the L, sub-elements and said second ML 2 sub- 
15 elements may be performed in parallel for each said first element. 

The ML 2 second sub-elements of the switch arrangement may be provided as a number M 
of second elements, each of said M second elements being associated with a number L 2 
of second sub-elements. 



20 



Each sub-element may be capable of generating at least one said service request. 



The first sub-elements and said second sub-elements may be bi-directional and provide 
both ingress and egress from the switch fabric. The first sub-elements may comprise said 
25 second sub-elements. 

The first sub-elements and said second sub-elements may be unidirectional and then said 
first sub-elements may provide ingress and said second sub-elements may provide 
- egress from the switch arrangement. 
30 

The first and second sub-elements may comprise ports in the switch arrangement and 
said first elements comprise aggregations of said first sub-elements. 

The first and second sub-elements may comprise ports in the switch arrangement, and 
35 the first elements may comprise aggregations of said first sub-elements and said second 
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elements comprise aggregations of said second sub-elements. 

The switch arrangement may comprise an input queued cell switch and said service 
requests comprise requests for transmitting a service information rate from one of said 
5 first sub-elements to at least one of said second sub-elements. 

The switch arrangement may comprise an input queued cell switch and said service 
requests comprise requests for transmitting at least one cell from one of said first sub- 
elements to at least one of said second sub-elements. 

10 

The switch arrangement may comprise an input queued packet switch and said service 
requests comprise requests for transmitting a service information rate from one of said 
first sub-elements to at least one of said second sub-elements. 

15 The switch arrangement may comprise an input queued packet switch and said service 
requests comprise requests for transmitting at least one packet from one of said first sub- 
elements to at least one of said second sub-elements. 

The packets may have a fixed-length and comprise cells and said packet switch may be 
20 an input queued cell switch arranged to switch fixed-length cells, and said service 
requests may comprise requests for transmitting one or more fixed-size cells from one of 
said first sub-elements to one or more of said second sub-elements. 

The packets may have a fixed-length and comprise cells and said packet switch may be 
25 an input queued cell switch arranged to switch fixed-length cells, and said service 
requests may comprise requests for transmitting a sen/ice information rate from one of 
said first sub-elements Li to one or more of said second sub-elements L 2 . 

The switch arrangement may comprise a circuit based switch and said service request 
30 comprises a request for a connection in a circuit-based switch. The switch arrangement 
may comprise a circuit based switch and said service request comprises a request for a 
bandwidth in a circuit-based switch. The switch arrangement may comprise a circuit 
based switch and said service request comprises a request for a service information rate 
in a circuit-based switch. The service information rate may be a bit rate. 

35 



WO 2005/032167 



21 



PCT/GB2004/004159 



The circuit based switch arrangement may comprise at least one switch taken from the 
group consisting of: any known time-domain, frequency domain, wavelength domain or 
space domain switching technologies. The circuit-based switch arrangement may 
comprise a combination of said switches. 

5 

The switch arrangement may comprise a network, and said elements may comprise 
aggregations of network terminals or nodes and said sub-elements may comprise network 
terminals or nodes. The switch arrangement may comprise an arrangement of inter- 
connectable sub-networks, where said elements comprise sub-networks and said sub- 
1 0 elements comprise network terminals or nodes. 

The network may be an optical network. The sub-networks may comprise optical 
networks. 

15 The elements may become sub-elements with respect to elements in a higher layer of 
matching. Multiple layers of matching may be performed in a hierarchy of matching levels. 

A second aspect of the invention provides a method as claimed in any previous claim, 
wherein the method of matching comprises: firstly, aggregating service requests to the 
20 highest level of the matching hierarchy, and secondly, resolving contention for said 
service requests at the highest level of the matching hierarchy, and thirdly, resolving 
contention in turn down through the matching levels to the lowest level of matching. 

A third aspect of the invention seeks to provide a matching method for a switch 
25 arrangement comprising a plurality N of input elements, each input element comprising a 
plurality (L,) of input sub-elements, and a plurality M of output elements, each output 
element comprising a plurality L 2 of output sub-elements, the matching method comprising 
the following steps: performing a first matching across the switch fabric for each of the 
plurality of N input elements and the ML 2 sub-elements by performing the steps of: 
30 summing a number of requests from each of the U sub-elements of the input element; 
generating a first N x ML 2 request matrix; matching the first request matrix to generate a 
first matrix of accepted requests; and performing a second matching across the switch 
fabric for each of the N input elements by performing the steps of: generating N 
asymmetric second Li x ML 2 matrices, for each of the N input elements; and matching 
35 each of the N asymmetric second matrices to generate N second matrices of accepted 
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requests; and generating a NL, x ML 2 matrix of accepted requests from the first N x ML 2 
matrix of accepted requests and the N second Li x ML 2 accepted request matrices. 

The NL, x ML 2 matrix of requests may be symmetric. may be equal to L 2 and N may be 
5 equal to M. The N second L, x ML 2 matrices may be asymmetric or symmetric 

The sub-elements may comprise ports on a switch. The sub-elements may comprise 
nodes or terminals in an optical network. The sub-elements may comprise nodes in an 
optical ring network. The sub-elements may comprise terminals in a passive optical 
10 network (whether amplified or not). 

The switch arrangement may comprise a packet switch arrangement. The packet switch 
arrangement may be capable of switching fixed-length packets. The switch arrangement 
may comprise a cell switching arrangement. The cell switching arrangement may be 
1 5 capable of switching packets. 

A fourth aspect of the invention seeks to provide a switch arrangement, the switch 
arrangement having number N of first elements, each first element arranged to at least 
provide ingress to a switch arrangement, each of the first N elements comprising a 

20 number L, of first sub-elements, the switch arrangement having a number ML 2 of second 
sub-elements arranged to at least provide egress from said switch arrangement, and 
wherein each of the first L, sub-elements is capable of conveying a service request for at 
least one of said second sub-elements ML 2 , wherein said service requests are conveyed 
by performing a matching method which comprises: firstly, for every one of the N first 

25 elements, aggregating service requests from all U first sub-elements to each of the ML 2 
second sub-elements, and secondly, resolving contention for said service requests from 
all N first elements to one or more of said second ML 2 sub-elements, and thirdly, for each 
first element, resolving contention between the L, sub-elements and said second ML 2 sub- 
elements, i 



3d 



In the fourth aspect, the matching method may be according to any one of the first, 
second or third aspects. 

A fifth aspect of the invention seeks to provide a network including a switch arrangement 
35 according to the fourth aspect 



WO 2005/032167 



23 



PCT/GB2004/004159 



A sixth aspect of the invention seeks to provide a suite of at least one computer programs 
arranged when executed to implement steps in a method according to the first, second or 
third aspects. At least one program may be arranged to be implemented by software 
5 running on a suitable computational device. At least one program may be arranged to be 
implemented by suitably configured hardware. 

A sixth aspect of the invention seeks to provide a scheduler for a switching arrangement, 
the scheduler arranged to perform a scheduling process, the scheduling process 
10 comprising: a matching method according to any one of the first, second or third aspects; 
and a time-slot assignment process;. 

A seventh aspect of the invention seeks to provide a matching method according to any 
one of the first, second or third aspects wherein the sub-elements comprise ports, and the 
15 matching updates the pointers to input ports according to the following rule: p out = 1 + [(LN 

- Pm + k) modLN ] and the output ports are updated according to the following rule: p in = 1 + 
[(LN-Potf + kUrfJ 

An eighth aspect of the invention seeks to provide a matching method according to any 
20 one of the first, second or third aspects wherein the sub-elements comprise ports, and the 
matching updates the pointers to input ports according to the following rule: p ou t = 1 + [(LN 

- Pin + k) modLN ]and the output ports are updated according to the following rule: p ln = 1 + 
[(m-Pout + k^ocJ 

25 In any matching method aspect of the invention, the method may be arranged to enable a 
multicast matching scheme to be implemented. 

In any matching method aspect of the invention, the ML 2 output sub-elements may be 
grouped first into M groups of L 2 sub-elements, and matching may be performed first at 
30 the group level between the N groups of Li input sub-elements and the M groups of L 2 
output sub-elements, and then, for each of the N groups of Li input sub-elements, 
between the L A individual input sub-elements and the M groups of L 2 output sub-elements. 

A ninth aspect of the invention seeks to provide a matching method for a number N of first 
35 elements, each first element arranged to at least provide ingress to a switch arrangement, 
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each of the first N elements comprising a number L, of first sub-elements, the. switch 
arrangement having a number ML 2 of second sub-elements arranged to at least provide 
egress from said switch arrangement, and wherein each of the first U sub-elements is 
capable of conveying a service request for at least one of said second sub-elements ML 2l 
5 wherein the ML 2 sub-elements are grouped into M aggregations of L 2 sub-elements, and 
the method comprises: firstly, for every one of the N first elements, aggregating service 
requests from all L, first sub-elements to each of the M aggregations of U second sub- 
elements, and secondly, resolving contention for said service requests from all N first 
elements to one or more of said M aggregations of L 2 second sub-elements, and thirdly, 
10 for each first element, resolving contention between the L, sub-elements and said M 
aggregations of L 2 second sub-elements. 

Another aspect of the invention seeks to provide a matching method, for a multi-stage 
switch arrangement having a plurality of logically associated inputs and a plurality of 

15 outputs, wherein the matching method comprises the steps of: for each logical association 
of inputs, aggregating service requests from every one of the inputs which form said 
logical association; resolving contention for said aggregated service requests between all 
of the logical associations to the outputs of the switch arrangement; and repeating the 
above steps in the matching method within each logical association for a subset of the 

20 inputs forming each said logical association until contention is resolved between the 
individual inputs of the switch arrangement and the outputs of the switch arrangement. 

Preferably, In each repetition, the number of inputs forming the logical association is 
reduced until each logical-association of a sub-set comprises a single input to the switch 
25 arrangement, said aggregated service requests comprise a single service request, 
whereby contention is resolved between each input of the switch arrangement and each 
output of the switch arrangement. 

Preferably, each step resolving contention between the outputs of the switch arrangement 
30 comprises resolving contention between a logical association of inputs and a logical 
association of outputs having the same number of inputs . 

Preferably, said multi-stage switch arrangement comprises a plurality of switching stages, 
at least one switching stage comprising: a plurality of switches which logically associated 
35 into different sets of switches, each set of switches being logically associated with one of 
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said logical associations of inputs of the switch arrangement, wherein each set of logically 
associated switches operate only on the inputs of the switch arrangement with which they 
are logically associated, the switch arrangement further comprising a global spatial 
switching stage arranged to receive traffic derived from any of the inputs of the switch 
5 arrangement via any logically adjacent sets of said switches. 

Preferably, said multi-stage switch arrangement comprises a plurality of switching stages, 
at least one switching stage comprising: a plurality of switches which logically associated 
into different sets of switches, each set of switches being logically associated with one of 
10 said logical associations of outputs of the switch arrangement, wherein each set of 
logically associated switches operate only to provide output to the outputs of the switch 
arrangement with which they are logically associated. 

Another aspect of the invention seeks to provide a multi-stage switch arrangement 
15 arranged to switch time-slotted traffic segments, the switch arrangement comprisingra 
plurality of switching stages including a spatial switching stage arranged to receive traffic 
which has been switched by at least one switching stage logically adjacent to the input of 
spatial switching stage, the spatial switching stage being further arranged to output to at 
least one switching stage logically adjacent to its output, each of said at least one 
20 switching stage logically adjacent to the input of the spatial switching stage comprises a 
plurality of input aggregation switching stages, each aggregation switching stage being 
logically associated with a subset of the inputs of the switch arrangement, each of said at 
least one switching stage logically adjacent to the output of the spatial switching stage 
comprises a plurality of output aggregation switching stages, each output aggregation 
25 switching stage being logically associated with a subset of the outputs of the switch 
arrangement, the mutli-stage switch being further arranged to implement suitable control 
means to enable the time-slotted traffic to be matched according to the matching method 
according to any method aspect of the invention. 

30 



Advantageously, the invention seeks to provide a scheduling algorithm suitable for a high- 
performance VOQ IQ switch which has a reduced level of complexity yet supports an 
35 acceptable level of throughput. The scheduling algorithm is provided with less 
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computational complexity by performing the matching over several hierarchical levels 
within and between smaller switches or sub-networks or aggregations of Input and output 
ports, by providing a matching algorithm which operates generally, but not exclusively, on 
an asymmetric request matrix. 

5 

Advantageously, the invention reduces the computing complexity and enables larger 
cell/packet switches/networks to be constructed without distributing the scheduling 
decisions too loosely between the smaller switches or sub-networks or aggregations of 
input and output ports so that performance is degraded. 

10 

The asymmetric request matrix grants requests between inputs and outputs of differing 
levels of aggregation, e.g., switch-port, node aggregation-node, ring-node, or PON- 
terminal. In general, as more than one hierarchical level of matching is performed 
between different sub-networks, multistage buffering and switching can be used to 
15 support this. Advantageously, however, in some embodiments of the invention, the multi- 
stage buffering/switching is implemented by means of multi-hopping. Advantageously in 
such embodiments, buffering remains at the switch/network edge. This means that where 
the invention is implemented in an otherwise optical network environment, the buffering 
can be implemented electronically, avoiding the expense of optical buffering technology. 

20 

Advantageously, the invention can provide a global frame-based optimal scheduling 
algorithm which operates both within and between each individual sub-switch/network, the 
scheduling algorithm comprising a matching algorithm stage and a channel assignment 
(time-slot assignment) stage. The global frame-based multi-level matching scheme uses 

25 multiple aggregation levels. Channel assignment can be provided by any suitable 
mechanism, for example, one example of a time-slot assignment process is described by 
the inventors in their United Kingdom Patent Application No. GB-A-0322763.4, the 
contents of which are hereby incorporated into the description by reference. In a 
preferred embodiment of the invention the channel assignment stage comprises a method 

30 of buffering the timeslot interchanging stages by multi-hopping (3 hops) between sub-sets 
of the network nodes (terminals) so that buffering can be located at the edge nodes only 
as described by GB-A-0322763.4. 

In contrast to the prior art, the invention may use asymmetric traffic request matrices, 
35 applied to different parts of the overall network with different levels of aggregation, in order 
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to reduce the matching complexity. For example, the asymmetric request matrix can be 
between input switch-output port or upstream ring-downstream node or upstream PON- 
downstream terminal. This allows sufficient information about individual port, node or 
terminal identities to be retained to prevent receiver contentions and source blocking, 
5 while reducing the overall matching complexity. 

The preferred features of the invention (or dependent accompanying claims) can be 
combined in with any of the aspects of the invention (or independent accompanying 
claims) in any appropriate manner apparent to those skilled in the art. The invention will 
10 now be described with reference to the following drawings which are by way of example 
only and in which: 

Figure 1 is a sketch ofaNxN input queued packet switch; 

15 Figure 2 is a sketch of a 4 x 4 input queued packet switch showing virtual output queues 
VOQs and its corresponding request matrix; 

Figure 3a is a sketch showing the input and output elements and sub-elements of a switch 
arrangement according to an embodiment of the invention; 

20 

Figures 3b and 3c show a simplified view of the switch in Figure 3a and an unpopulated 
symmetric LN x LN matrix for the switch shown in Figure 3a respectively; 

Figure 4 shows steps in a method according to an embodiment of the invention; 

25 

Figure 5 is a sketch showing schematically the aggregation of requests for the switch 
shown in Figure 3a in the first level matching method according to an embodiment of the 
invention; 

30 Figure 6 shows schematically the steps of aggregating requests and the 1 st level of 
matching in multi-level matching scheme according to an embodiment of the invention; 

Figure 7 shows schematically the steps of performing multiple, parallel matchings of N 
elements, each having L input ports, including de-aggregation, in the 2 nd level of a multi- 
35 level matching scheme according to the invention; and 
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Figure 8 shows the pointer positions for the 2x4 asymmetric request matrix [r^nj)] in the 
first cycle or frame (k=0) for a multi-level matching scheme according to an embodiment of 
the invention. 

5 ...... 

The best mode of the invention as currently contemplated by the inventors will now be 
described. This invention relates to the matching part of a frame-based scheduling 
algorithm. The matching algorithm is able to use multiple levels of aggregation for packet 
requests. The term packet is used here to refer to multi-cast and unicast packets of fixed 
10 length (i.e., fixed as in a cell has a fixed length) or variable length as is apparent to those 
skilled in the art. The switch arrangements described relate to a number of possible 
embodiments, including packet, cell, and circuit switching arrangements. A cell switch 
can additionally include means to switch packets of fixed and/or variable length in some 
embodiments of the invention. 

15 

The invention can be used to match service requests in any switch arrangement provided 
over a network. For example a matching for service rate requests between ports on any 
switch can be provided by the invention, as well as a matching on a larger scale between 
sub-networks within a communications network. For example, the matching process can 
20 be used when traffic needs to travel between interconnecting optical networks and rings. 
As has been mentioned above, the invention can also, in some embodiments, be used to 
match service requests in a circuit switch environment. 

A specific embodiment of the invention will now be described with reference to Figures 
25 3a,3b, and 3c of the accompanying drawings. Figure 3a shows schematically a switch 
comprising a number of elements #a1,...,#aN and #b1,...#bM between which traffic can be 
switched over switch fabric 31. Each of the elements #a1..#aN has a number of sub- 
elements, and each of the elements #b1..#bM has a number of sub-elements. The 
number of sub-elements may not be equal to the number of sub-elements L 2 , and the 
30 number of elements N may not equal the number of elements M in some embodiments of 
the invention. In a preferred embodiment of the invention the product UN is equal to the 
product L 2 M, and in the best mode of the invention N = M and L,= L 2 . The sub-elements 
may comprise unidirectional ingress or egress to the switch fabric, or they each may 
comprise bi-directional ingress and egress facilities to and from the switch fabric. 

35 
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In one embodiment of the invention, the elements N f M comprise sub-networks in a 
network connected by a hub switch fabric, and each sub-element, comprises a node or 
terminal on each sub-network ^ #a1...#aN or sub-network #b1...#bM. For example, 
consider an embodiment where a switch is arranged to switch traffic moving between 
5 different rings and/or networks and needs to be capable of switching traffic at different 
levels of aggregation, for example between optical networks (particularly passive optical 
networks PONs). Such a switch needs to have high performance and support fast 
switching speeds in a reliable and fair manner, as discussed by Bianco et al in their paper 
on Access Control Protocols for Interconnected WDM Rings in the DAVID Metro Network, 
10 IWDC 2001 (International Workshop on Digital Communications), Taormina, Italy, 
September 17-20, 2001 the contents of which are hereby incorporated by reference. 

It will be appreciated by those skilled in the art that whilst Figure 3 is described with 
reference to elements and sub-elements, there is a clear analogy to embodiments in 
15 which the elements comprise, for example, different terminals or ports of a switch, or 
different terminals of a network, or different terminals of a sub-network, or a sub-network 
having a number of different terminals, or a switch having a number of terminals or ports. 

In the prior art, it is known to perform the matching between the input and output ports or 
20 terminals of a switch or network conventionally in one operation or hierarchical level. The 
preferred embodiment of the invention proposes a matching scheme for a switching 
arrangement comprising a number of input sub-elements (for example ports or terminals) 
which are grouped into elements and the matching is performed in more than one 
hierarchical level in a global, endrto-end manner. 

25 

The invention seeks to increase the amount of parallel processing that can be performed 
in the matching and reduce the computing steps required for the matching. The elements 
can, in some embodiments of the invention, be arbitrary sub-sets of the sub-elements, for 
example, the sub-elements could comprise ports (terminals) without any particular 

30 physical significance or in alternative embodiments comprise ports on real sub-networks. 
For example, if the switch input and output elements comprise rings in an interconnecting 
switching arrangement of rings, then the input and output sub-elements could comprise 
the individual nodes or terminals. Alternatively, if the switching arrangement is a large 
switch comprising a plurality of interconnected smaller switches, then the sub-elements 

35 could comprise the ports on smaller switches. 
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This invention therefore provides a global matching algorithm for use in either single-stage 
or multi-stage switching and buffering networks, without resorting to complete autonomy 
of the smaller elements (i.e. sub-sets of ports or terminals, switches or sub-networks), nor 
5 aggregating requests at too high a level (e.g. ring-ring or PON-PON). The invention 
provides a matching method in which the sub-elements (e.g., the ports or terminals) are 
grouped into elements and the matching is performed in more than one hierarchical level, 
and in a global, end-to-ehd manner. This has the benefit of increasing the amount of 
parallel processing that can be performed in the matching and reducing the computing 
1 0 steps required for the matching. 

As described with reference to the prior art, matching algorithms conventionally make use 
of symmetric traffic request matrices between cell- or packet-switch ports, or between 
rings or PONs in packet networks, or between nodes or terminals in packet networks. But 

15 this invention employs traffic request matrices which are in general (but not exclusively) 
asymmetric, and which are applied to different parts of the overall network with different 
. —-.levels of aggregation, in order to reduce the matching complexity. For example, at a first 
level of aggregation the matching may be between input elements and output sub- 
elements, and a second level of matching may be between input sub-elements and output 

20 sub-elements. In this way, an asymmetric request matrix can be generated for service 
requests between an input switch element and an output port of an output switch element. 
Alternatively, an asymmetric matrix could be generated between an upstream ring 
element and a downstream node sub-element or alternatively, an upstream PON element 
and a downstream terminal sub-element. 



25 



30 



By providing a two-level, global (i.e., end to end) matching process between the elements 
and sub-elements and sub-elements to sub-elements, sufficient information about 
individual port, node or terminal identities can be retained to prevent receiver contentions 
and source blocking, while reducing the overall matching complexity. 



In some embodiments of the invention, more than one level of aggregation can be 
implemented in the matching method, and as such elements become sub-elements with 
respect to elements in a higher layer of matching. For example, it is possible for multiple 
layers of matching to be performed in a hierarchy of matching levels in some 
35 embodiments of the invention. As an example, one method of matching according to an 
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embodiment of the invention comprises the following steps: 

firstly, aggregating service requests to the highest level of the matching 
hierarchy! and 

secondly, resolving contention for said service requests at the highest level of 
5 the matching hierarchy, and 

thirdly, resolving contention in turn down through the matching levels to the 
lowest level of matching. 

In Figure 3a, a switch 31 is shown schematically to be arranged to switch traffic between a 
10 number of elements N (denoted #a1...#aN), each having Li sub-elements across a 
suitable switch fabric 31 (for example a hub) to a number of output sub-elements, here 
ML 2 in number. Each element a#1..a#N comprises a number of different sub-elements 
L 1f and in Figure 3a, an embodiment of the invention is shown where the ML 2 sub- 
elements are shown aggregated into M groups of L 2 sub-elements. The grouping (or 
15 aggregation) of the output sub-elements into M elements, does not occur in other 
embodiments of the invention. Switch 31 therefore comprises NLi inputs and ML 2 
outputs, i.e., switch 31 effectively comprises an NL| x ML 2 switch. As an example, 
consider an optical embodiment of the invention where aggregation of both inputs and 
outputs may be present if the N, M elements are PONs or optical ring networks as then 
20 both the Li and L 2 sub-elements may comprise user terminals or nodes. 

Figure 3b shows a simplified representation of the switching arrangement showed in 
Figure 3a, which illustrates more clearly the sub-elements forming the inputs and outputs 
of the switch 31. In Figure 3b, switching arrangement 40 comprises LiN input sub- 

25 elements i (for example ports) and L 2 M output sub-elements j(for example ports) j. A 
conventional matching algorithm for frame-based scheduling such as that which Bianco et 
al describe employs multiple phases for matching, such as was described referring to the 
prior art. Such a conventional technique produces a match for a symmetric request 
matrix, LiN x L 2 M (or if N = M and U = L 2 =L, LNxLN) in size such as is shown in Figure 

30 3c (where a grid is shown as the matrix as yet unpopulated). 

Asymmetric, Multi-Stage Matching Using Multiple Levels of Aggregation 

35 Referring now to Figure 4 of the accompanying drawings, an overview of the steps in a 
matching method according to the invention is shown suitable for the switch environment 
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shown in Figures 3a,3b, and 3c of the accompanying drawings. 

Where a conventional input queued switch arrangenpent is being considered, the term 
sub-element is used to refer to any ports and the term element then refers to an 
5 aggregation of such ports. Where the switch arrangement is provided by a network 
element interconnecting a number of optical networks (for example, an optical ring 
network, or passive optical networks (PONs), the term sub-element is used to refer to any 
nodes on the rings or terminals on the PONs and the term element refers to an 
aggregation of such nodes or terminals, for example, the term element could refer as such 
10 to a ring network or a PON. 

As has been mentioned, in some embodiments of the invention, the switch arrangement 
comprises part of a network, and the network comprises interconnected sub-networks. In 
such embodiments, at one hierarchical level the sub-networks are the elements, and the 

15 nodes or terminals in each sub-network comprise the sub-elements, sub-element. For 
example, where the switch arrangement is provided by a network element interconnecting 
a number of optical networks (for example, passive optical networks (PONs)), the term 
sub-element is used to refer to any nodes or terminals on the PONs and the term element 
can refer to the PON. As will be appreciated by those skilled in the art, the hierarchical 

20 matching process according to the invention is not limited to such embodiments, but may 
be implemented in any switching environment where differing levels of aggregation can be 
effected at least for the inputs to the switch arrangement. 

In Figure 4, an algorithm according to one embodiment of the invention is shown in which 
25 NLi input sub-elements are capable of generating service requests for ML 2 output sub- 
elements over a switch fabric. The NL t input sub-elements are aggregated as N elements 
#a1...#aN, each element comprising sub-elements. The ML 2 output sub-elements may 
be aggregated into M elements, each element comprising L 2 sub-elements in some 
embodiments of the invention, but need not be so aggregated in other embodiments of the 
30 invention. In Figure 4, the L 2 sub-elements are aggregated into M=N elements, 
#b1..#bM. Aggregation for each of the N elements #a1...#aN of the switch arrangement 
30 is initially performed in step 41 by summing the total number of requests for each of the 
U sub-elements of each of the N elements, i.e., for each element the total number of 
requests destined for each of the ML 2 sub-elements is summed over its Li input ports in 
35 step 41 . Each element N can be considered alternatively as a group of sub-elements. 
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A first matching is then performed in which the service requests are matched at a first 
aggregation level by generating an asymmetric N x ML 2 request matrix for each of the N 
input elements in step 42. The notation used here means that the matrix has N rows and 
5 ML 2 columns, where N is an integer and ML 2 is an integer. 

A second matching process is then performed in step 43 in which N separate matchings 
are performed, one for each of the N elements comprising Li sub-elements (input ports). 
This involves N separate U x L 2 M asymmetric request matrices. De-aggregation is 

10 thereby performed back from the aggregate level of the N elements to the ML 2 output sub- 
elements (i.e., output ports) to the aggregate level of L t input ports to ML 2 output ports in 
step 44. It will be appreciated by those skilled in the art that the N matchings of step 43 
could of course be performed sequentially, but it is advantageous in terms of the total time 
taken to run the algorithm if the number of computing steps (times) can be reduced by 

15 performing them simultaneously, in parallel, using multiple matching "processors". The 
latter is the preferred approach and is adopted in the best mode of the invention currently 
contemplated by the inventors. It is also possible for the number of elements and sub- 
elements to differ on each side of the switch as has been mentioned before. 
Aggregation of Requests 

20 r— — ™- 

Figure 5 shows schematically how each of the Li sub-elements of input element #a1 in 
Figure 3a is initially aggregated into a group of sub-elements. Strictly speaking, because 
the particular matching algorithm being used as an example takes the queue lengths as 
inputs for its first normalisation stage, the requests in this step are simply the queue 
25 lengths. (However, the number of requests could be any alternative number of requests 
for cells/packets to be switched, using other criteria for calculating that number. For 
example, each VOQ request used could be calculated as the queue length limited to a 
maximum of F requests for the next frame). 

30 Figure 6 shows the aggregation of request step 41 and the first levef of matching step 42 
of Figure 4 in more detail. In Figure 6, N = M, and Li = L 2 = L for simplicity. 

In Figure 6, there are N groups of L sub-elements (here a sub-element comprises an 
input port). Each element employs an L x LN asymmetric queue matrix [Q(i,j)]indiv«iuai to 
35 represent the numbers of backlogged cells/packets in each input port of the element 
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destined for each output port of the switch arrangement (i.e., of the switch or switching 
network as appropriate). 

Each L x LN matrix [Q(ij)] in dividuai is simply that portion of the global LN x LN [Q(i,j)] matrix 
5 for all VOQs of the entire switch or switching network relating to that particular element 
comprising a group of L sub-elements. Thus each element (alternatively each group of 
input ports) has all its input port-output port requests recorded. The queue lengths of all 
input ports in each [Q(i,j)]individuai matrix are then aggregated (summed) into N aggregated 
queue matrices, each aggregated queue matrix having the form of a 1xLN matrix. The N 
10 aggregated queue matrices are equivalent to a single N x LN aggregated queue matrix 
[Q(nj)] a gg representing the traffic queued in the N groups of input ports for the output ports 
of the switch arrangement. 

1 st Level of Matching 

15 

The first level of matching is just one matching covering the entire switch or network. It 
takes the N x LN asymmetric, aggregated queue matrix [Q(nj)] a gg as its input, as shown in 
Figure 1 . 

20 Output and input booking using the example matching algorithm are summarised as 
follows. Outputs for the matching still represent the overall output ports of the switch, but 
inputs represent here the N elements, each element comprising a group of sub-elements 
(i.e. a group of input ports). The matrices now possess an index representing the 1 st or 2 nd 
level of matching. 

25 

Firstly, the aggregated queue matrix undergoes a normalisation stage: 
[Q(n,j)]agg=>[Q norm (n,j)] aga , [ri(n,j)] 

Then the output booking and input booking phases described herein above are performed 
30 in a similar manner: 

Output Booking phase: [r^nj)] => [gi(n,j)]; ]T gi(nj) <. F- []T Qnom.(n,j)] a g g 

n n 

Input Booking phase: [gi(n j)] => [ai(nj)]; £ ai(n,j) <> F 

j 
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Here the g^ij) are elements in the first matrix of granted requests and the a^ij) are 
elements in the first matrix of accepted grants. 

2 nd Level of Matching 

5 

Figure 7 shows in more detail steps 43 and 44 in which multiple, parallel matchings of N 
elements of input ports , including de-aggregation, are performed in the second level of 
matching. In the 2 nd level of multi-level matching the aggregated acceptances in the 
acceptance matrix [ai(n,j)] from the 1 st stage of matching provide the limits for matching 

10 between the overall input and output ports within each of the N groups of input ports, i.e., 
within each of the N elements. The input for the matching within each element or group of 
sub-elements is taken as the original L x LN asymmetric queue matrix [Q(i,j)]individuai- 
Performing the matchings automatically provides de-aggregation back from the level of 
the grouped input ports-output ports to individual input ports-output ports. Normalisation 

15 and output and input booking are then performed in the manner described below. In this 
2 nd level, outputs and inputs of the matching once again represent the overall output and 
input ports of the switch/network. 

Normalisation stage: [Q(i .individual => [QnormO JMncMduai, [r 2 <i,j>3 
20 Output Booking phase: [r 2 (i,j)] => [g 2 (i,j)]; £ g2(i,j) < a^nj) - []T Q n orm(ij)]indMduai 

. . i i 

Here the g 2 (i f j) are elements in the second matrix of granted requests and the a 2 (i,j) are 
elements in the second matrix of accepted grants. 

The summation is taken over only the input ports within an element, and the value of n in 
25 the summation is obviously the identity of that element. 

Input Booking phase: [g 2 (i j)] => [a 2 (i,j)]; £ a 2('>i) * F 

J 

An example demonstrating a specific embodiment of the invention - Multi-Level Matching 
30 -Aggregation 

As a simple example of the hierarchical, multi-level matching principle, it is possible to 
partition the overall queue matrix [Q(i,j)] for the switch in Eqn.1 into N=2 elements each 
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comprising L=2 input ports (i.e., N= 2 groups of L=2 sub-elements), and to aggregate the 
requests (queue lengths) destined from the same group of input ports to each output port 
into a single 2x4 matrix, i.e. 

5 [Q(i,j)]individual^[Q(n,j)]agg= l]£ Q (I J) Individual = J " 

["4 8 1 2j 
[8 1 2 4J 



10 



25 



Multi-Level Matching - the First -Level Matching Normalisation Stage 



Because the input "ports" for this matrix are the elements (i.e., the groups of input ports), 
the row-sums over the elements are obviously larger, typically, than the column sums over 
output ports (which have not been aggregated). We will define maxval as the maximum 
column-sum or (row-sum/L), the latter being (row-sum/2) in this example, because each 
15 element or group of sub-elements contains L=2 input ports. With this definition, maxval is 
again 15, and every queue length is multiplied by the ratio F/15=4/15 and the integer part 
of the resulting number is taken. Hence the normalised queue matrix becomes 

Eqn.24 [CWn j)] aflg = [J \ \ J] 

All of these cells or packets are assumed already to be granted by the output ports and 
20 accepted by the elements at the group level for the sub-elements of that element. The 
request matrix presented to the next "no overbooking" stage is the difference between the 
original queue matrix and the normalised queue matrix, i.e. the remaining requests 
Eqn. 25 [ri(n,j)] = [Q(n,j)] agg - [Q„orm(nj)]agg 



[3 6 12 9l [0 1 3 2l 
" [l2 9 3 6J " [3 2 0 lj 
_ [3 5 9 7l 
= [9 7 3 5j 



Multi-Level Matching - the First-Level Matching "No Overbooking" Stage - Output Booking 
Phase 



30 



The number of requests in effect already granted by the output ports in the normalisation 
stage is 
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Eqn. 26 Q norm (n ,j)] agg = ]? 3 3 3] 

These are precisely the same numbers as were granted by the normalisation stage in 
conventional single-level matching (Eqn.4). 

5 Once again, the remaining number of grants available in each output port is therefore 
Eqn. 27 [f f f f]-[3 3 3 3]=[i i l l] 

Step 3 of the "no overbooking" algorithm described by Bianco et al applies again. But the 
NOB25 pointer up-date rule needs to be modified for the asymmetric request matrix 
10 [ri(n,j)] f to ensure that input ports and output ports point to each other, even though there 
are different numbers of each. (NB the N input ports are synonymous at this 1 st matching 
level with the N groups of overall input ports). Input and output ports for this l^-level 
matching now require slightly different relationships between ports, i.e. 

15 Multi-Level Matching - the First-Level Matching Pointer Up-Date Rule for Asymmetric 
Reguest Matrix: 

Eqn. 28 for input ports: p out = 1 + [(LN - P !n + k) mp d ln] 

for output ports: p in = 1 + [(LN - P 0 ut + k) mod J 

20 

In our example with L=2 and N=2, this becomes 
Eqn. 29 p ou t = 1 + [(4 - P ln + k)^ 4 ] 

Pin =1 +[(4-Pout + k) m0 d2] 

25 

Figure 8 summarises the pointer positions for the 2x4 asymmetric request matrix [r^n j)] in 
the first cycle or frame (k=0). In any cycle (frame) k, two input ports point to two output 
ports, each of which output ports points back to the same input port that points to it. The 
remaining two output ports also point to the two input ports. Hence each input port is 
30 pointed to by two output ports, but only two of the four output ports are pointed to by input 
ports. After 4 cycles or frames, each input port has pointed to each output port once in 
turn, and each output port has pointed to each input port twice. 

Hence in the first frame k=0, with L=2 and N=2 in this example, output port 1 points to 
35 input port 2, 2 points to 1 , 3 points to 2 and 4 points to 1, i.e. the pointers point to requests 
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r(2,1), r(1,2), r(2,3) and r(1,4) in Eqn.13. All of these matrix elements have more than one 
request, and because Eqn.27 allows only 1 more available grant for each output port, 
each of these four matrix elements will be granted one more request, Lev - 

Eqn. 30 additional output booking grants, [gi(nj)] = ^ q l o] 

5 

Multi-Level Matching - the First-Level Matching "No Overbooking" Stage - Input Booking 
Phase 

From Eqn.24, the number of requests in effect already accepted by the input ports (really 
10 the 2 groups of input ports) in the normalisation phase is 



Eqn. 31 Qnorm(n j)] a gg = 



Because each sub-element group contains 2 overall input ports, the remaining number of 
acceptances available in each sub-element group is therefore 

Eqn. 32 " l£ CUmCnJ)^ = [j] - [j] = [* 

15 The matrix to be used in this input booking phase is the additional output booking grants 
matrix [gi(n,j)] (Eqn.30). Step 2 of the "no overbooking" algorithm applies. All of the 
additional grants are therefore accepted, so the additional acceptance matrix is 

Eqn. 33 additional input booking acceptances, [a 1addifcn ai(nj)] = ^ * ° * j 
The final 1 st -level acceptance matrix becomes 

20 Eqn. 34 [ ai (nJ)] = [Qn 0im (nj)] agg + [a 1adcfi tiona,(n,j)] = ^ \ \ J] + [J \ \ J] = [° \ \ J] 

Note that all output ports fill all F=4 time slots and all input ports (sub-element groups) fill 
all 2F=8 time slots, in this first frame. A full set of 16 cells or packets are accepted. 



25 Multi-Level Matching - the Second Level Matching for Sub-element Group 1 

From Eqn.23 the queue matrix for the first sub-element group (i.e. the aggregation of 
input ports comprising the first element) is 

Eqn. 35 [QOJWindMdual =[2451] 

30 and from Eqn34 the number of acceptances to each output port from the 1 st level of 
matching for this aggregation are 
Eqn. 36 [ai(1j)l=[o 233] 
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These acceptances represent the maximum number of grants that will be allowed by each 
output port to all input ports in this 2 nd level of matching. 

Multi-Level Matching - the Second Level Matching for Sub-element Group 1 
5 Normalisation Stage 

The maximum row-sum or column-sum, maxval, in Eqn.35 is 15. The normalised queue 
matrix [Q n0 mi(i j)]intivuuai is obtained from Eqn.35 by multiplying each element by the factor 
F/maxval = 4/15 and taking the integer part of the resulting number, i.e. 

10 Eqn. 37 [QnormO j)]indwlduaJ = ^ ^ 2 o] 

All of these cells or packets are assumed already to be granted by the output ports and 
accepted by the input ports. The request matrix presented to the next a no overbooking" 
stage is the difference between the original queue matrix and the normalised queue 
matrix, i.e. the remaining requests 

15 



Eqn. 38 [r 2 (ij)] = [Q(i,j)]indlvidual - [Qnorni(U)]individual = 




Multi-Level Matching - the Second Level Matching for Sub-element Group 1 "No 
Overbooking" Stage - Output Booking Phase 

20 The number of requests in effect already granted by the output ports in the normalisation 
stage is 

Eqn. 39 []T QnorniCUMindividijal =[0132] 

i 

The number of additional grants allowed is 
Eqn.^40 

25 [ai(1j)]-[£ Qnorm(ij)]indivkiual= [0 2 3 3] - [0 1 3 2] = [0 1 0 l] 

i 

Step 3 of the "no overbooking" algorithm applies. The pointer positions in the first cycle or 
frame (k=0) are as in Figure 8. Output port 2 points to input port 1 and output port 4 also 
points to input port 1 . Both additional grants are made, i.e. 



30 Eqn. 41 additional output booking grants, [g 2 (i j)] = 
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Multi-Level Matching - the Second Level Matching for Sub-element Group 1 "No 
Overbooking" Stage - Input Booking Phase 

The number of requests in effect already accepted by the input ports in the normalisation 
5 stage is 

Eqn. 42 QnormO j)]mdMdual = 

J 

The number of additional acceptances allowed is 

Eqn. 43 [£] " ^ Q n°™(U)]indIvldual = 

The request matrix for this input booking phase is the additional output booking grants 
10 matrix [g2(i,j)l (Eqn.41). Step 3 of the "no overbooking" algorithm applies. In the first cycle 
or frame input port 1 points to output port 4 (Figure 8), so the additional input booking 
acceptance matrix becomes 

Eqn. 44 [a^oUl J)l = [° ^ ^ o] 

The final acceptance matrix is the sum of the acceptances from the initial normalisation 
15 (Eqn.37) plus these additional acceptances from the "no overbooking" algorithm (Eqn.44), 
i.e. 

Eqn. 45 [a 2 (i = [QnormO j)]ind™dual+[a2addiUonal(i J)] 

^[0012] [0 0 0 ll 
" |_0 1 2 0J + |_0 0 0 Oj 

" |_0 1 2 Oj 









4" 






_4_ 




E3-KI 
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Multi-Level Matching - the Second Level Matching for Sub-element Group 2 



From Eqn.23 the queue matrix for the second sub-element group (i.e. the second group of 
25 sub-elements) is 

Eqn. 46 [Q(i j)Wua. = [J J J J] 

and from Eqn.34 the number of acceptances to each output port from the 1 st level of 
matching are 

Eqn. 47 [ai(2,j)]= [4211] 

30 

These acceptances represent the maximum number of grants that will be allowed by each 
output port to all input ports in this 2 nd level of matching. 



WO 2005/032167 



41 



PCT/GB2004/004159 



Multi-Level Matching - the Second Level Matching for Sub-element Group 2 
Normalisation Stage 

The maximum row-sum or column-sum, maxval, in Eqn.46 is 15. The normalised queue 
5 matrix [Q n0 rm(i j)]individuai is obtained from Eqn.46 by multiplying each element by the factor 
F/maxval = 4/15 and taking the integer part of the resulting number, i.e. 

Eqn. 48 [Qnorm(i,j)]indivldiial " [2 0 0 l] 

All of these cells or packets are assumed already to be granted by the output ports and 
accepted by the input ports. The request matrix presented to the next "no overbooking" 
10 stage is the difference between the original qjjeue matrix and the normalised queue 
matrix, i.e. the remaining requests 

Eqn. 49 [r 2 (i,j)l = [Q(i .DlraTividua] - [Qnoim(i j)]indh/idual 

= [4 8 1 2l n 2 0 Ol 
" [8 1 2 4J " |_2 0 0 lj 

15 = [ 3 6 1 2 1 

[6 1 2 3J 

Multi-Level Matching - the Second Level Matching for Sub-element Group 2 "No 
Overbooking" Stage - Output Booking Phase 

The number of requests in effect already granted by the output ports in the normalisation 
20 stage is 

Eqn. 50 Qnorm(U)]indMdual = [3 2 0 l] 

The number of additional grants allowed is 

Eqn. 51 [ai(2j)]-[£ Qnorm(i,j)]indiv»duaJ = [4 2 1 l] - [3 2 0 l] = [l 0 1 0] 

i 

25 Step 3 of the "no overbooking" algorithm applies. The pointer positions in the first cycle or 
frame are as in Figure 8. Output port 1 points to input port 2 and output port 3 also points 
to input port 2. Both additional grants are made, i.e. 

Eqn. 52 additional output booking grants, [g 2 (i j)] = ^ ° ° jjj 

30 Multi-Level Matching - the Second Level Matching for Sub-element Group 2 "No 
Overbooking" Stage - Input Booking Phase 
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The number of requests in effect already accepted by the input ports in the normalisation 
stage is 

Eqn. 53 QnormO j)]lndividual = 

j 

The number of additional acceptances allowed is 



20 



5 Eqn. 54' 



n(i;j)]indMdual = 



4" 




4 





The request matrix for this input booking phase is the additional output booking grants 
matrix [g 2 (i,j)] (Eqn.52). Step 3 of the "no overbooking" algorithm applies, in the first cycle 
or frame input port 2 points to output port 3 (Figure 8), so the additional input booking* 
1 0 acceptance matrix becomes 



Eqn. 55 



[a2additi« 



ional(ij)] = [J J ? o] 



The final acceptance matrix is the sum of the acceptances from the initial normalisation 
(Eqn.48) plus these additional acceptances from the "no overbooking" algorithm (Eqn.55), 
15 i.e. 

= Qnorm(i»j)]indMdual+[92additional(iij)] 
_ |*1 2 0 Ol [0 0 0 Ol 

" [2 0 0 . 1 J + [0 0 1 oj 

= [1 2 0 Ol 
~ [2 0 1 1J 



Eqn. 56 



[a 2 (i,j)]i= 3 ,4 



Multi-Level Matching — Overall Acceptance Matrix 



25 Eqn. 57 



30 



The overall matrix of accepted requests is the concatenation of Eqn.45 and Eqn.56 for the 
two sub-element groups, i.e. 

0 0 13' 

r . x , 0120 

WJH- 12 0 0 
2 0 1 1 

Note that the 2 nd level of matching has been unable to maintain the full set of 16 
acceptances achieved by the 1 st level of matching of the sub-element groups. Only 14 cell 
or packet requests are finally accepted. This contrasts with the acceptance matrix 
resulting from conventional, single-level matching in Eqn.22, which achieves a full set of 
16 acceptances. The reason for the reduction in accepted requests may be due to the 
nature of the modified NOB25 pointer up-date rule suggested for use with asymmetric 
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request matrices in Eqn.28. This is discussed below, and a further modification is 
proposed. 

Multi-Level Matching - Pointer Up-Date Rules for Asymmetric Request Matrices 

5 

For the particular asymmetric request matrices used in the working example, there 
appears to be a problem with the modified NOB25-like pointer up-date rule (Eqn.28). It 
can be shown that there are pairs of output ports that always point to just one, common, 
input port in every frame. (The particular input port for a given pair of output ports changes 

10 cyclically from frame to frame). This can result in requests being granted by two output 
ports to the same input port during the output booking phase, causing overbooking, which 
causes one of these grants to be dropped during the following input booking phase. This 
never happens for symmetric request matrices, because output port pointers never point 
to the same input port; there are enough input ports for all the output port pointers to point 

15 to different input ports. The problem has been found to happen when only two of the 
output ports are able to grant additional requests^ and the two ports happen to be a pair 
that point to the same input port. 

One embodiment of the invention provides a possible solution to this problem by deciding 
20 the pointer positions after the number m of output ports that are, allowed to make 

additional grants is known. This would no longer be a deterministic pointer up-date rule. 

However, the nature of the no overbooking algorithm described above ("NOB25") could be 

preserved to some extent by adapting the rule to the variable number of output ports m. 

Once this number m is known for a matching in a frame, these m ports would be ranked in 
25 order and the output port pointer positions would be calculated as follows 

Eqn. 58 for output ports: p in = 1 + [(m - P out + k) mD d J 

where P 0lrt is now the rank of the output port allowed to make additional grants, not the 
30 output port's identity. If the same sub-set of output ports are allowed to make additional 
grants recurrently in each frame, then the overall effect may be like NOB25, in that the 
pointers would step around these ports by one port in each frame. In the worked example, 
if the same two output ports were to recur in every frame, they would always point to 
different input ports, which should remove the output overbooking. 
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Because there are always more output ports than input ports in the asymmetric request 
matrices, so that no two input ports ever need to point to the same output port, there is no 
need to adapt the NOB25 rule for the input portsf For these ports the pointer up-date rule 
can remain deterministic. The input port pointer positions would be calculated as in 
5 Eqn.28, i.e. 



Eqn. 59 



for input ports: p 0lrt = 1 + [(LN - P in + k) mD d ln] 



10 



where P }n is the input port's identity. 



Using this rule, it can be shown that the overall acceptance matrix for the worked example 
using multi-level matching becomes 

....... .,0 0 13" 

r- r /• M 0 2 2 0 

Eqn. 60 [a 2 (i,])]= x 2 x Q 

3 0 0 1 

The matching now accepts a full set of 16 requests in the first frame. They are not all 
15 taken from the longest VOQs. For example, a 2 (3,3) is one of the shortest queues with only 
one request. 



Those skilled in the art will appreciate that the number of hierarchical matching levels 
depends on the number of levels of aggregation used: In the examples discussed with 
20 reference to Figures 3 to 8 of the accompanying drawings, only two levels of aggregation 
were used. For larger switch arrangements it is possible to have more than two levels of 
aggregation and the number of matching levels increases accordingly. 



The invention can be applied to switching arrangements having bi-directional 
25 elements/sub-elements as is apparent to those skilled in the art. The invention can be 
implemented in any suitable form, including as a suite of one or more computer programs 
which may be implemented using software and/or hardware and the matching algorithm 
may be provided in a form which is distributed amongst several components. 

30 The matching process can thus be implemented by one or more hardware and/or software 
components arranged to provide suitable means. For example, to implement the 
matching process on requests for service which are queued at the input of the input 
queued switch, the hardware and/or software component implementing the invention may 
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include arbiters of parallel or serial operation. 

Those skilled in the art will also realise (hat where reference has been made to the switch 
arrangement having NL inputs and NL outputs, this can be generalised to the case where 
5 a switch arrangement has NLiinputs and ML 2 outputs, and that specific features of such 
embodiments are not limited to the specified number of inputs and outputs which have 
been described here for simplicity. 

In the embodiment of the invention described above, the multi-level matching technique 
10 first matches N input elements to ML 2 output sub-elements, at the highest level of the 
matching hierarchy, then matches the L A input sub-elements within each input element to 
the ML 2 output sub-elements. As will be apparent to those skilled in the art, more than two 
hierarchical levels can be implemented by this invention, but the embodiment described 
above employs a two level hierarchy for simplicity. This can provide a better matching for 
15 request matrices than is possible using other scheduling algorithms that perform the 
matching with a greater degree of aggregation of output ports, nodes or terminals, such as 
ring-to-ring or PON-to-PON. 

Those skilled in the art will recognise that in the context of the invention, the term element 
20 refers collectively to a group of sub-elements. The above embodiments of the invention 
have described various examples where firstly all the input elements of the switch 
arrangement are matched to the output sub-elements of the switch arrangement (i.e., 
groups of sub-elements are matched to output sub-elements of the switch arrangement) 
and then the individual sub-elements in each group are matched to the output sub- 
25 elements of the switch arrangement. However, it is possible to group the sub-elements of 
the outputs, and outlet grouping can be combined with input grouping. 

OUTLET GROUPING 

30 It is known to have switch (and network) arrangements where groups of output ports all 
have the same destination, e.g. where they all transmit on the same link to the next 
switch. It is known from ATM switching that under these circumstances it does not matter 
to which particular output port of such a group of output ports the individual cells are sent 
by the ATM switch fabric. This is known as outlet grouping, and it reduces the blocking 

35 probability of output contention, by sharing the group of output ports between all cells 



WO 2005/032167 



46 



PCT/GB2004/004159 



destined for the same outgoing link. This approach is also known to be attractive in optical 
packet networks, where a number of wavelength channels within the same outgoing fibre 
link are shared between the cells or packets within the fibre. It does not matter which 
wavelength channel is used by each individual cell or packet. Not only is blocking resulting 
5 from output contention reduced by outlet grouping, but the computing complexity of 
matching and channel assignment (both time-slot and wavelength) may also be reduced, 
due to the aggregation of output ports, (output sub-elements) into groups of output ports 
(output elements). 

10 Although there are potential problems, of. .cell or . packet mis-sequencing at subsequent 
switches, which may need to be addressed, such outlet grouping can be dealt with very 
easily within the framework of multi-level matching. In this embodiment applied to outlet 
grouping, consider L 2 output sub-elements within an output element constituting an outlet 
group, of which there are M. Matching is still performed in multiple levels. For example, 

15 with just two levels of matching, the first (highest) level would be between input elements 
and output elements and the second level of matching would be between input sub- 
elements and output elements. Since both levels match to output elements rather than 
sub-elements, the number of cell or packet requests that can be accepted to each output 
element is obviously L 2 times greater than to each individual output sub-element. 

20 

Accordingly, process for resolving contention when scheduling traffic across an input- 
queued switch arrangement is provided by the invention. The process is also capable of 
resolving service contention across a circuit switch arrangement. The process involves a 
method to match service requests between a number of input sub-elements and a number 

25 of output sub-elements. The input sub-elements are aggregated into groups whose 
service requests are then matched to either the output sub-elements or to aggregations of 
the output sub-elements. The individual input sub-elements of each aggregation of input 
sub-elements are then matched to the output sub-elements or to the aggregation of output 
sub-elements. This provides a hierarchical, two-level matching process. More generally, 

30 a matching process is provided for a number N of first elements, each first element 
arranged to at least provide ingress to a switch arrangement, each of the first N elements 
comprising a number of first sub-elements, the switch arrangement having a number 
ML* of second sub-elements arranged to at least provide egress from said switch 
arrangement, and wherein each of the first Li sub-elements is capable of conveying a 

35 service request for at least one of said second sub-elements ML 2 , wherein the process 
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comprises: firstly, for every one of the N first elements, aggregating service requests 
from all Li first sub-elements to each of the ML 2 second sub-elements or to each of the M 
aggregations of L 2 second sub-elements, and secondly, resolving contention for said 
service requests from all N first elements to one or more of said second ML 2 sub-elements 
5 or of said M aggregations of L 2 second sub-elements; and thirdly, for each first element, 
resolving contention between the Li sub-elements and said second ML 2 sub-elements or 
said M aggregations of L 2 second sub-elements. The matching process can be extended 
to any number of hierarchical levels by considering elements in one hierarchical level as 
sub-elements in a higher level. Matching is performed first at the highest level of the 
10 hierarchy, then in turn down through the matching levels to the lowest matching level of 
the hierarchy. 



